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EVACUATION  OP  A  YULE  PROCESS  WITH  IMMIGRATION 


by 

Mark  Brown,  Sheldon  Ross,  Richard  Shorrock 
1.  Introduction 

In  the  second  section  of  this  paper  we  obtain  a 
correspondence  between  the  joint  distribution  of  the  epochs 
of  birth  in  a  Yule  process  and  the  order  statistics  of  a 
sequence  of  independent  and  identically  distributed  (i.i.d.) 
exponential  random  variables.  This  correspondence  is  then 
used  to  obtain  simple  proofs  of  some  Yule  process  results. 

In  particular  a  simple  proof  of  a  result  due  to  Neuts  and 
Resnick  [1]  concerning  the  conditional  distribution  Of  the 
birth  epochs  given  the  number  of  such  epochs  in  (o,t)  is 
presented. 

In  the  final  three  sections  we  deal  with  the  problem 
that  motivated  this  paper.  .Namely  if  a  population  of  indi¬ 
viduals  arrives  at  a  contaminated  geographical  area  in  accord 
with  a  Yule  process  with  immigration,  and  if  all  people  in 
the  area  are  to  be  evacuated  at  time  T  because  of  tha 
unhealthy  conditions  in  the  area,  then  if  we  are  allowed  an 
additional  evacuation  time  in  (0,T)  how  can  we  choose  it  in 
an  optimal  manner? 
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2.  The  Yule  Process 

The  Yule  process  is  a  pure  birth  process  with 
birth  parameters  A^  ■  jA,  j  ^  0  .  In  other  words,  each 
individual  in  the  population  independently  gives  birth 
in  accordance  with  an  exponential  distribution  with  rate  A 
We  assume  that  there  is  a  single  person  in  the  population 
at  time  t»0j  Define  T^,  i  >  1,  to  be  the  time  of  the 
i-th  birth,  and  let  N(t)  equal  the  number  of  births  in 
(o,t) . 


Let  X1#  . . .  ,  X^  be  k  i.i.d.  exponential 
random  variables  with  rate  A  and  let  equal  the 

i-th  smallest  of  X^,...,Xk  for  i«l,...,k  .  It  directly 
follows,  from  the  lack  of  memory  of  exponential  random 
variables,  that 


TrV  *  *  fTk 


has  the  same  joint  distribution  as 


X(k)"X(k-l)  'X(k)”X(k-2) '  •  •  •  'xi 


We  shall  refer  to  this  fact  as  the  correspondence  C. 
As  an  application  of  the  correspondence  we  note  that 

Jc 

P{Tk  <  t}  -  P(x(k)  <  t>  -  [l-e”XtQ 


and  thus 


P{N(t)  =  k}  =  P{N(t)  >  k}  -  P{N(t)  >  k  +  1} 

=  P{Tk  <  t)  -  P(Tk+1  <  t} 

=  e’Xt  [l  -  e-XtDk 

which/  of  course/  is  just  the  well  known  result  that  the 
transition  probabilities  in  the  Yule  process  are  given  by 

_  ...  -xt  r,  -xt‘|k 

pi,k+i(t>  "  e  J 

It  easily  follows  from  the  above  that 

lim  P{e"Xt  N  (t)  >  x)  *  e-x 
t-^00 

and,  in  fact,  it  can  be  shown,  by  regarding  Tk  as  a 
weighted  sum  of  i.i.d.  exponential  random  variables,  that 
Tk/log  k  -*■  y-  with  probability  1,  and  this  can  easily  be 
shown  to  yield  that 

fog  -►  \  with  probability  1. 

The  correspondence  C  immediately  yields  the 
following 

Proposition  1:  Given  Tk*t,T^, . . .  ,Tk_^  have  the  same 


joint  distribution  as  the  order  statistics  from  a  sample 


of  k-1  i.i.d.  random  variables  having  density  function 


f(x) 


■( 


0  <  x  <  t 

otherwise 


Proof :  From  the  correspondence  C  ve  note  that  the 
conditional  distribution  of  T^,...,Tk_^  given  Tk**t 
is  the  same  as  the  conditional  distribution  of 
t-X^k-1j  / . . .  t-X^j  given  t-X^j.  As  f  (x)  is  just 
the  conditional  density  of  t-Y  given  that  Y  <  t, 
where  Y  is  an  exponential  random  variable  with  rate  X , 
the  result  follows. 

While  Proposition  1  yields  the  conditional  dis¬ 
tribution  of  times  of  birth  given  Tk*t,  it  is  more 
useful  to  obtain  their  conditional  distribution  given 
information  about  N(t).  To  obtain  this,  note  that  the 


conditional  distribution  of  Tk+1  given  N(t)*k,T^, . . . ,Tk 
is  the  same  as  the  conditional  distribution  of  Tk+1 
given  N(t)«k.  Therefore,  given  N(t)»k,  Tk+1  is 
conditionally  independent  of  T^,...,Tk,  and  thus  the 
conditional  distribution  of  T^,...,Tk  given  N(t)*k 
and  Tk+1*t  is  the  same  as  the  conditional  distribution 
of  T^, . . .  ,T^  given  N(t)=k.  Hence,  as  the  event  that 
N(t)»k  and  Tk+1»t  is,  with  probability  1,  equivalent  to 

k+1*t,  we  obtain  from  Proposition  1. 


the  event  that  T 


Proposition  2;  Given  N(t)Bk,T^, . . . rT^  are  distributed 
as  the  order  statistics  from  a  sample  of  size  k  from  a 
population  having  density 


f  (x) 


0  <  x  <  -1 

otherwise 


Proposition  2  can  be  used  in  establishing  re¬ 
sults  about  the  Yule  process  in  the  same  way  that  the 
corresponding  result  for  Poisson  Processes  is  used.  For 
example,  consider  the  random  variable  Y(t)  defined  by 

N(t) 

Y(t)  -  l  g. (t-T.) 
i-1  1  1 


where  gi(*)»  i  >.  1#  are  i.i.d.  random  functions  that 
are  independent  of  the  Yule  process.  (Yule  shot  noise 
would  probably  be  an  appropriate  name  for  the  stochastic 
process  (Y(t),  t  >_  0>).  Letting  i|>t(u)  *  E |e^uY 
be  the  characteristic  function  of  Y(t),  we  obtain 
^t(u)  by  conditioning  on  N(t)  as  follows. 

S^iuY(t)J  _  E^E  JeiuY (t)  |N<t)  -  kQ 

Now,  since  given  N(t)"k,  the  unordered  set 

are  distributed  as  i.i.d.  random  variables  with  density 


given  in  Proposition  2  it  follows  that 


3.  Optimal  Evacuation  of  a  Yule  Process  with  Immigration 
Individuals  arrive  at  a  geographical  area  that  is 
initially  empty,  in  accordance  with  a  pure  birth  process 
with  birth  parameters  X.  =  jX  +  6,  j^O.  Due  to  contami- 

^  i 

nation,  this  geographical  area  is  unsafe  for  its  population 
and  at  some  fixed  time  T  in  the  future  everyone  in  the 
area  will  be  evacuated  and  no  further  immigration  will  he 
allowed. 

If  an  individual  spends  a  total  time  of  x  units  in 
the  area  before  being  evacuated  then  let  us  suppbge  that  a 
cost  of  g(x)  is  incurred  (by  society).  We  are  interested 
in  deriving  an  expression  for  the  total  expected  cost  incur¬ 
red  by  time  T.  To  do  so  let  us  at  first  assume  that  a 
single  individual  is  present  at  time  t=o  and  that  the  im¬ 
migration  parameter  0  equals  0.  In  this  case,  we  have  by 

(2)  that  the  expected  cost  incurred  by  time  T  is 

T 

C..(T)=  g  (T)  +  Xe*T  /  e“Xx  g(x)  dx 
A  0 

When  there  is  a  single  individual  present  at  time  0  but 
6^0  then,  since  each  immigrant  can  be  thought  of  as 
starting  his  own  Yule  process  when  he  arrives,  we  obtain  by 
conditioning  on  the  total  number  of  immigrants  that  arrive 
in  (0,T)  that  C2(T),  the  expected  cost  incurred,  is  given 
by 

T 

C,(T)  -  C.  (T)  +  0  T  /  C.  (T  -  x)  Si 
21  0  1  T 


\ 


T 

=  C.  (T)  +  0  /  C.  (T  -  x)  dx 
1  0  1 


Finally,  when  there  is  no  one  present  at  time  t=o,  ,;e 
obtain,  by  conditioning  on  the  arrival  time  of  the  initial 
immigrant,  that  the  total  expected  cost  incurred  is 

T 

C (T)  -  /  C. (T  -  s)  0  e"0S  ds 
0  1 


In  the  special  case  in  which  the  loss  incurred  is  equal  to 
the  time  spent  in  the  contaminated  area,  i.e.,  in  the  case 
g(x)  =  x,  a  simple  computation  yields  that 

C  (T)  =  ^  [eAT  -XT  -  1] 

X^ 


when  g(x)  *  x 


3.  Optimal  Evacuation  of  a  Yule  Process  with  Immigration 
Individuals  arrive  at  a  geographical  area  that  is 
initially  empty,  in  accordance  with  a  pure  birth  process 
with  birth  parameters  A..  *  jX  +  0,  j^.0.  Due  to  contami¬ 
nation,  this  geographical  area  is  unsafe  for  its  population 
and  at  some  fixed  time  T  in  the  future  everyone  in  the 
area  will  be  evacuated  and  no  further  immigration  will  be 
allowed.. 

If  an  individual  spends  a  total  time  of  x  units  in 
the  area  before  being  evacuated  then  let  us  suppose  that  a 
cost  of  g  (x)  is  incurred  (by  society) .  We  are  interested 
in  deriving  an  expression  for  the  total  expected  cost  incur¬ 
red  by  time  T.  To  do  so  let  us  at  first  assume  that  a 
single  individual  is  present  at  time  t*o  and  that  the  im¬ 
migration  parameter  6  equals  0.  In  this  case,  we  have  by 

(2)  that  the  expected  cost  incurred  by  time  T  is 

T 

C.(T)=  g(T)  +  XeXT  /  e”Xx  g(x)  dx 
A  0 

When  there  is  a  single  individual  present  at  time  0  but 
Q  0  then,  since  each  immigrant  can  be  thought  of  as 
starting  his  own  Yule  process  when  he  arrives,  we  obtain  by 
conditioning  on  the  total  number  of  immigrants  that  arrive 
in  (0,T)  that  C2(T),  the  expected  cost  incurred,  is  given 
by 

T 

C,(T)  -  C.  (T)  ♦  6  T  /  C.  (T  -  X) 

1  1  0  1 


\ 


\ 


dx 

T 


T 

■  C.  (T)  +  0  /  C.  (T  -  x)  dx 
1  0  1 


Finally,  when  there  is  no  one  present  at  time  t*o,  we 
obtain,  by  conditioning  on  the  arrival  time  of  the  initial 
inunigrant,  that  the  tntal  expected  cost  incurred  is 

T 

C(T)  »  /  Cj  (T  -  s)  e  e"08  ds 
0  * 


In  the  special  case  in  which  the  loss  incurred  is  equal  to 
the  time  spent  in  the  contaminated  area,  i.e.,  in  the  case 
g(x)  =  x,  a  simple  computation  yields  that 


C  (T)  -  ^  [eAT  -XT  -  1] 
X^ 


when  g(x)  »  x 


4.  Optimal  Intermediate  Evacuation  Time 

Suppose  now  that  an  intermediate  evacuation  time  t  , 

0  <  t  <  T,  at  which  time  everyone  present  in  the  area  would 

be  evacuated,  is  to  be  chosen.  The  area  would  then  again 

fill  up  with  individuals  between  times  t  and  T,  and,  at 

T,  the  final  evacuation  would  be  made  and  the  area  would  be 

permanently  sealed  off.  The  problem  is  to  choose  t  so 

to  minimize  the  total  expected  cost  incurred  by  time  T. 

Let  us  say  that  we  are  in  state  (t,  x.  ,...,x  )  if 

in 

the  intermediate  evacuation  has  not  yet  been  made  and  if 
there  are  n  individuals  of  respective  ages  x1,..,,xn 
present  at  time  T-t.  If  we  are  in  state  (t,  x1,...,xn)  and 
we  decide  to  evacuate  immediately  then  our  total  expected 
cost  is 

n 

C(t)  +  l  g(x. )  ,• 

i-1  1 

on  the  other  hand  if  we  wait  a  fixed  additional  time  e 
befoi'3  evacuating  then  our  total  expected  cost  is 

n  e 

C(t  -  e)  +  l  g{x.  +  e)  +  (nX  +  0)  /  g(s)  ds  +  o(e) 
i-1  1  0 

Hence  evacuating  in  state  (t,  x^,.«.fx  )  is  better  than 

waiting  a  fixed  additional  time  e  before  evacuating  if 

Ji  '  h  e 

C(t)  +  g(x.)  <  C(t  -  e)  +  l  g (x .  ♦  e)  +  (n*  +  0)/  g(s)ds  +  d  (e) 

i-1  .  1  “  i-1  1  0 
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or,  equivalently,  if 

C (t)  -  C (t  -  e)  <  ?  9(xl  *  E)  -  »<*!> 

c  “  i-1  c 


Letting  e-*-0  shows  that  if  J  g(s)  da 


e 

+  (nX  +0)  /  g (s)ds  +  o (e) 
0  e  e 

o(e)  ,  then  evacuating 


0 

when  in  state  (t,  )  is  better  than  waiting  an  infini¬ 

tesimal  additional  amount  of  time  if 

n 


C'(t)  <  l  g'(x.) 

i-1  1 


e  •  •; 

We  shall  assume  that  g(s)  is  such  that  /  g(s)ds  *  o(e)  ,  and 

0  ' 

thus  the  above  defines  the  infinitesimal  look  ahead  rule  (see 
[2])  -  it  says  to  evacuate  when  n  individuals  of  respective 
ages,  xlf...,xn  are  present  at  time  T-t  if  ,  , 

n 

l  g’  (x.)  >  C’(t) 
i-1  1  ” 

Proposition  3:  -  . 

Assume  (i)  g(01  -  0  .. 

(ii)  g*  (x)  >  0 
(iii)  g' '  (x)  £  0 

(iv)  lim  f  .  g(s)d8  n  •  - 

e-°  J  « 

Then  the  infinitesimal  look  ahaad  rule  is  optimal.  That 

■  ,  .  ,  ’  <  •  *• 

is,  assuming  (i) ,  (ii) ,  (iii),  (iv) ,  the  intermediate 
evacuation  time  that  minimizes  the  total  expected  cost 


S3K  S&XiXi 


0 


-Il¬ 


ls  the  one  that  evacuates  at  :he  smallest  t  such  that 


N(t) 

t  g'(x.)> 
i-i  1 


C'  (T  -  t) 


where  N(t)  is  the  number  of  individuals  in  the  area  at  time 
t  and  their  respective  ages  are  *  In  other 

words,  the  intermediate  evacuation  should  be  made  the  first 
time  that  the  instantaneous  rate  of  cost  increase  due  to  those 
present  in  the  area  is  greater  than  the  instantaneous  cost 
increase  if  an  evacuation  is  made. 

Proof :  It  was  proven  in  [2]  that  if  the  set  of  states  that  the 

infinitesimal  look  ahead  rule  tells  us  to  evacuate  at  is  a 

closed  set  of  states,  in  the  sense  that  once  we  are  in  one  of 

these  states  then  we  can  never  leave  the  set,  then  this  rule 

is  optimal.  In  our  case  since  g'  (xi>  cannot  decrease 

i-1 

as  t  increases  (until  an  evacuation  occurs)  ye  will  establish 
the  result  if  we  can  show  that  C'  (T  -  t)  is  a  nonincreasing 
function  of  t.  That  is  we  must  show  that  C(T)  is  a  convex 
function  of  T. 


Ci  (T)  -  g'  (T)  +  Xg  (T)  +  X2  eXT  /  e"Xx  g  (x)  dx  >  0 

x  ...  Q 

and  thus 

C!J  (T)  -  g"  (T)  +Xg'  (T)  +  X3  eXT  /  e”Xx  g  (x)  dx  +  X2  g  (T)  >  0 
A  ,  O 


"Tv  .  -T  ^ ~ 


and  thus 


C,  (T)  -  C.  (T)  +  6  /  C.  (y)  dy 
*  0 


(T)  -  C|  (T)  +  e  Cx  (T) 


Differentiating  again  yields 


C«  (t)  .  cj  (T)  +  8  (T)  >  0 


Finally, 


C  (T)  -  0  e"0T  /  e0y  C2  (y)  dy 
0 

T 

C'(T)  -  -02  e”0T  /  e0y  c,  (y)  dy  +  0  C,  (T) 

o  *  * 

T 

cn(T>«  -e2  c2  <t)  +  e3  e”0T  /  e0y  c2  (y)  +  e  cj  (t) 


Hence,  we  need  to  show  that 


62  e-0T  /  e0y  C2  (y)  dy  +  CJ  (T)  >  0Cj  (T) 


Integrating  by  parts  yields  that 

f 

T  T  T 

/  6  e0y  c,  (y)  dy  -  C.  (y)  e0y  |  -  /  e8y  Cl  (y)  dy 

0  4  Q  0  * 

-  C,  (T)  e0T  -  /  e0y  C'  (y)  dy 
Z  O  z 

J 


and  thus  we  need  to  show  that 
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1s  quite  possible  that  we  might  not  have  any  information  about 
the  population  size  before  the  evacuation  is  made.  In  this 
case  we  would  thus  be  forced  to  choose  a  constant  time  for  the 
intermediate  evacuation.  Slice  evacuating  at  the  fixed  time  t 
leads  to  an  expected  cost  of  C(t)  +  C  (T  -  t)  it  follows  from 
convexity  that/  under  the  assumptions  of  Proposition  3r  the 
optimal  constant  evacuation  time  is  t  *  T/2.  In  fact  this 
result  easily  generalizes  to  the  case  where  there  are  n  con¬ 
stant  intermediate  evacuations  to  be  made.  Under  the  assump¬ 
tions  of  Proposition  3,  it  again  follows  by  convexity  that  the 
optimal  times  would  be  T/n+1,  2T/n+l,  ...  nT/n+1  . 

5.  The  Unknown  Parameter  Case 

Up  to  this  point  we've  assumed  that  X  and  0  were 
known  parameters.  However,  it  may  well  be  the  case  that  one 
or  even  both  of  these  values  are  unknown.  What  procedure  should 
we  employ  in  this  case? 

To  make  explicit  its  dependence  on  X  and  0:;  let 
us  write  C(T,  X,  8)  for  C(T).  Prom  Proposition  3,  .  it  . would, 
seem  that  a  reasonable  procedure  would  be  to  evacuate  at  the 
first  time  t  such  that 

N(t)  _  . 

L  9'  (*L)  >  ^  C(T  -  t,  X(t),  0  (t) ) 

i“l  ,  ..  ‘  *  »  '■ 

j  -  •  *  ...  ^  j  .7 

where  x^,  ...  x^^  are  the  respective  ages  of  those  in  the 
area  at  time  t,  and  X  (t)  and  6  (t)  are  respective  estimates 
of  X  and  8  at  time  t.  (Naturally  we  are  assuming  that 
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g(x)  satisfies  the  conditions  of  Proposition  3).  Thus  we  are 
led  to  determining  estimates  for  X  and  6. 

If  we  let  I(t)  denote  the  number  of  immigrants  to 
the  area  in  [c,t]  then  0  ■  ^  is  the  obvious  estimate  for 

0. 

Letting  A(t)  denote  the  sum  of  the  amount  of  time 
that  has  been  spent  in  the  area  by  those  present  at  time  t, 
and  letting  B(t)  denote  the  number  of  births  that  occur  in  the 
area  in  [o,t],  it  turns  out  that  the  maximum  likelihood  esti- 
mate  of  X  is  X  (t)  ■  .  (This  is  the  same  as  the  total 

time  on  test  statistic  used  in  exponential  sampling  schemes). 
Since  the  increase  from  birth  to  birth  of  the  sum  of  the  times 
spent  in  the  area  are  independent  and  identically  distributed 

exponential  random  variables  with  mean  1/X,  it  easily  follows 

/\ 

that,  when  0  >  0,  X(t)-*X  as  t-*»  with  probability  1. 

Thus,  for  instance,  a  reasonable  procedure  for  de¬ 
termining  the  intermediate  evacuation  time  in  the  case  where 
g(x)>x,  would  be  to  evacuate  the  first  time  t  for  which 

N (t)  >  I(t)  A(t)  exp 
t  B(t) 

It  should  be  noted  that  the  intermediate  evacuation  time  defined 
above  may  not  be  optimal  in  any  sense.  However  it  is  clearly 
the  procedure  suggested  by  Proposition  3.  It  is  interesting  to 
note  that  when  B(t)  ■  0  the  above  reduces  to  evacuating  at 


-16- 


the  first  t  for  which 

N  (t)  >  I(t)  (T  -  t) 
t 

But  since  N(t)  =  I(t)  +  E(t),  the  above  inequality  is  equiva¬ 
lent  to 

t  >  T/2 

Hence  if  no  births  occur  by  time  T/2  then  the  intermediate 
evacuation  should  be  made  at  T/i*. 


V 
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